9/8/2018 


Finding Probabilities 


1.3.3 Finding Probabilities 

Suppose that we are given a random experiment with a sample space S. To find the probability of an event, there are usually two steps: 
first, we use the specific information that we have about the random experiment. Second, we use the probability axioms. Let's look at an 
example. Although this is a simple example and you might be tempted to write the answer without following the steps, we encourage you 
to follow the steps. 


Example 1.9 

You roll a fair die. What is the probability of E = {1,5}? 

• Solution 

o Let's first use the specific information that we have about the random experiment. The problem states that the die is fair, 
which means that all six possible outcomes are equally likely, i.e., 

P({1»=P({2» = ... = P({6». 

Now we can use the axioms of probability. In particular, since the events {1}, {2}, • ■ • , {6} are disjoint we can write 

1 = P(S) 

= p({ 1}U{2}U--.U{6}) 

= P({l}) + P({2}) + .-- + P({6}) 

= 6P({1». 

Thus, 

P({l» = P({2}) = --. = P({6}) = i 

Again since {1} and {5} are disjoint, we have 

P(P) = P({1,5}) = P({1» + P({5}) =l = \. 

It is worth noting that we often write P(l) instead of P({1}) to simplify the notation, but we should emphasize that probability is 
defined for sets (events) not for individual outcomes. Thus, when we write P(2) = jr, what we really mean is that P({2}) = i. 

We will see that the two steps explained above can be used to find probabilities for much more complicated events and random 
experiments. Let us now practice using the axioms by proving some useful facts. 


Example 1.10 

Using the axioms of probability, prove the following: 

a. For any event A, P(A C ) = 1 — P(A). 

b. The probability of the empty set is zero, i.e., P(0) = 0. 

c. For any event A, P(A) < 1. 

d. P(A -B) = P(A) - P{A n B ). 

e. P(A U P) = P(A) + P(B) — P(A l~l P), (inclusion-exclusion principle forn = 2). 

f. If A C P then P(A) < P(B). 

• Solution 

o a. This states that the probability that A does not occur is 1 — P(A). To prove it using the axioms, we can write 
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1 = P(S) (axiom 2) 

= P(A U A c ) (definition of compliment) 

= P(A ) + P(A C ) (since A and A c are disjoint) 

b. Since 0 = S c , we can use part (a) to see that -P(0) = 1 — P(S ) = 0. Note that this makes sense as by 
definition: an event happens if the outcome of the random experiment belongs to that event. Since the empty set does 
not have any element, the outcome of the experiment never belongs to the empty set. 

c. From part (a), P(A) = 1 — P(A C ) and since P(A C ) > 0 (the first axiom), we have P(A) < 1. 

d. We show that P(A ) = P(A Hi B ) + .P(^4 — B ). Note that the two sets A Hi B and A — B are disjoint and 
their union is A (Figure 1.17). Thus, by the third axiom of probability 

P{A) = P((A Hi B)U(A- B )) ( since A — (AnB)u(A- B)) 

= P(A D B) + P(A — B) (since A Hi B and A — B are disjoint). 


s 



Fig. 1.17 - P{A) = P(A n B) + P(A - B). 

Note that since A-B = ArB c , we have shown 

P(A) = P{A n B) + P(A n B 0 ). 

Note also that the two sets B and B c form a partition of the sample space (since they are disjoint and their union is the 
whole sample space). This is a simple form of law of total probability that we will discuss shortly and is a very useful 
rule in finding probability of some events. 

e. Note that A and B — A are disjoint sets and their union is A U B. Thus, 
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P(AU B) = P(AU (B - A)) (AuB = Au(B-A)) 

= P(A) + P(B — A) (since A and B — A are disjoint) 

= P{Al) + P{B) - P(A fl B) (by part (d)) 

f. Note that A C B means that whenever A occurs B occurs, too. Thus intuitively we expect that P{A) < P^B). 
Again the proof is similar as before. If A C B, then A Hi B = A. Thus, 

P(B) = P(A nB) + P(B - A) (by part (d)) 

= P(A) + P(B - A) (since A = A n B) 

> P(A) (by axiom 1) 


Example 1.11 

Suppose we have the following information: 

1. There is a 60 percent chance that it will rain today. 

2. There is a 50 percent chance that it will rain tomorrow. 

3. There is a 30 percent chance that it does not rain either day. 


Find the following probabilities: 

a. The probability that it will rain today or tomorrow. 

b. The probability that it will rain today and tomorrow. 

c. The probability that it will rain today but not tomorrow. 

d. The probability that it either will rain today or tomorrow, but not both. 

• Solution 


o An important step in solving problems like this is to correctly convert them to probability language. This is especially useful 
when the problems become complex. For this problem, let's define A as the event that it will rain today, and B as the event 
that it will rain tomorrow. Then, let's summarize the available information: 


1. P(A) = 0.6, 

2. P(B) = 0.5, 

3. p\a c n B c ) = 0.3 


Now that we have summarized the information, we should be able to use them alongside probability rules to find the 
requested probabilities: 

a. The probability that it will rain today or tomorrow: this is P(A U B) . To find this we notice that 


P(A U B) = 1 


P( (AUB)‘ 


by Example 1.10 


= 1 — P(A C n B c ) by De Morgan’s Law 

= 1-0.3 
= 0.7 


b. The probability that it will rain today and tomorrow: this is P(A fl B) . To find this we note that 

P{A (1 B) = P(A) + P(B) — P(A U B) by Example 1.10 

= 0.6+ 0.5-0.7 
= 0.4 


c. The probability that it will rain today but not tomorrow: this is P[A H B c ). 


P(AnB c ) = P(A-B) 

= P(A) — P(An B) by Example 1.10 

= 0.6 - 0.4 
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= 0.2 

d. The probability that it either will rain today or tomorrow but not both: this is P(A — B ) + P(B — A ). We have 
already found P(A — B ) = .2. Similarly, we can find P(B — A): 

P(B — A) — P(B) — P(B fl ^4) by Example 1.10 

= 0.5-0.4 
= 0.1 

Thus, 

P{A - B) + P(B -A) — 0.2 + 0.1 = 0.3 


In this problem, it is stated that there is a 50 percent chance that it will rain tomorrow. You might have heard this information from news 
on the TV. A more interesting question is how the number 50 is obtained. This is an example of a real-life problem in which tools from 
probability and statistics are used. As you read more chapters from the book, you will learn many of these tools that are frequently used in 
practice. 

Inclusion-Exclusion Principle: 

The formula P(A U B) = P(A) + P(B) — P(A PI B) that we proved in Example 1.10 is a simple form of the inclusion- 
exclusion principle. We can extend it to the union of three or more sets. 


Inclusion-exclusion principle: 

. P(A U B) = P(A) + P(B) - P(A n B), 

. P(A U B U C) = P(A) + P(B) + P(C)~ 

—P(A CB) - P(A n C) - P(B nC) + P(A nBnC) 


Generally for Tl events A \, A 2 , • ■ • , A n , we have 

^(ur., a) = Eh P{ A) - Ei<i A A nXj) 

1 E,., t PIAf .V'A) +(-l)”- 1 p(n"„A) 

<— previous 
next —> 
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